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This progress report consists of the following two parts: 

I. Fuel-Optimal Trajectories for Aeroassisted Coplanar Orbital Tranfer 

Vehicles in the Presence of Uncertainties due to Modelling Inaccuracies 


II. Neighboring Optimal Guidance for Aeroassisted Noncoplanar Orbital 
Transfer. 
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ABSTRACT 


We intend to devise a neighboring optimal guidance scheme for a nonlinear 
dynamic system with stochastic inputs and perfect measurements as applicable 
to fuel optimal control of an aeroasslsted orbital transfer vehicle. For the 
deterministic nonlinear dynamic system describing the atmospheric maneuver, a 
nominal trajectory is determined. Then, a neighboring, optimal guidance scheme 
is obtained for open loop and closed loop control configurations. Taking 
modelling uncertainties into account, a linear, stochastic, neighboring 
optimal guidance scheme is devised. Finally, the optimal trajectory is 
approximated as the sum of the deterministic nominal trajectory and the 
stochastic neighboring optimal solution. Numerical results are presented for a 
typical vehicle. 
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NOMENCLATURE 


A ■ 

“ ^ p R / 

R/ 2m 

A1 

- Cqo S p R Ha/2m 

A2 

” Clr S p R Ha/2m 

a c 

- Rc/Ra 

a d 

- Rd/Ra 

b 

- Ra/Ha 

C D 

“ C D0 + K C L 2 

C 

- c l/ c lr 

Em 

- (L/D) max 

C LR 

■ \J c do/k 

h 

- H/Ha 

C D0 

- zero-lift drag coefficient 

C L 

- Lift coefficient 

g 

- gravitational acceleration 

k 

- induced drag factor 

m 

- vehicle mass 

R 

- radius of earth center 

Ra 

- radius of atmosphere 

Re 

- radius of earth 

S 

- aerodynamic reference area 

H 

- altitude 

V 

- velocity 

7 

- flight path angle 

P 

- density 

t 

- time 


v 


P - costate variable 


n - Lagrange multiplier 

Av - characteristic velocity 

J - performance index 

J - augmented performance index 
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I . INTRODUCTION 


The derivation of the optimal control law resulting from a minimum fuel 
criterion is addressed for the coplanar orbital transfer maneuver [6,7,11]. 

This maneuver involves a transfer from high earth orbit to a low earth orbit 

with the control law minimizing the fuel consumption. The performance index is 

* 

expressed in terms of the characteristic velocities for deorbit and reorbit 
[10]. A TPBVP is solved by applying the Pontryagin minimum principle with 
given initial and final constraints, and a fixed terminal time. The open loop 
control arising from the minimum principle requires a new computation of 
the control when the initial and/or final condition is subject to small 
changes; this introduces errors in the solution. Errors are also introduced by 
the inexact knowledge of the true model. 

To be more specific, after solving the second variation problem [3,4] that 
results from linearizing around a nominal solution, a control is computed that 
describes the correction to the original nonlinear control problem. This 
correction is due to small perturbations in the initial and/or terminal 
conditions . Furthermore , the perturbed control law is used as a control law 
that will drive the stochastic dynamic equation when perfect knowledge of the 
state is assumed (see figure #2 and figure #3). The stochastic differential 
equations are subject to uncertainties due to lack of knowing the exact model 
associated with the nonlinear TPBVP. 

This report represents a continuation of the original effort reported in 
[10,11]. There, the coplanar and noncoplanar problem is solved by neglecting 
the contraints imposed on the control, whereas now these constraints are fully 
addressed. The outline of the procedure used for the open loop feedback 
control and the closed loop feedback control are shown below. 
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Open Loop Feedback Control: 

Step #1. Solve the TPBVP for the deterministic problem x - f(x,u,t). 

Step #2. Save the nominal state & 0 (t) and nominal control u 0 (t). 

Step #3. Solve the neighboring TPBVP along the nominal solution of Step 

# 2 . 

Step #4 Save the gain matrices and K 2 that correspond to the control 
feedback law generated in step #3 , 

Au - k^As + k 2 A£ 

where A£ are the adjoint variables. 

Step #5 Linearize x - f(x,u,t) along So> Mo and add noise n: 

Ajc - f x jAs + f u Au + n, As(t 0 ) - given 
So.Mo io.Mo 

Step #6. Simulate the stochastic equation of Step #5 by using the control 
law described in Step #4. 

Closed Loop Feedback Control: 

Step #1. Solve the TPBVP for the deterministic problem x - f(i.M.t)» 

Step #2. Save the nominal state Xo(t) and nominal control u 0 (t). 

Step #3. Solve the matrix Riccati equation backward in time. 

Step #4. Save the gain matrix k that corresponds to the control 
feedback law 
Am “ k As. 

Step #5. Linearize x - f(x, m. t) along Xq, Mo an< * noise n: 

As - f x |As + f u |Ali + B 
— o > Mo — o > Mo 
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Step #6. Simulate the stochastic equation of Step #5 by using the control 


law given in Step #4. 


II. DETERMINISTIC RESPONSE 

The transfer of the space vehicle from a HEO at radius to a LEO at R c 
is due to the velocity reduction caused by atmospheric drag forces. Given a 
tangential propulsive burn, having characteristic velocity AVd, the vehicle 
travels through an elliptical orbit (figure #1). At point E, the spacecraft 
enters the atmosphere with flight path angle y e and velocity V e . During the 
atmospheric flight the vehicle experiences a reduction of velocity. At point 
F, the spacecraft leaves the atmosphere with flight path angle yf and velocity 
Vf. As a final stage, the maneuver ends with a circularizing or reorbit burn 
having a characteristic velocity AVc to make the spacecraft enter into the low 
earth orbit. A mathematical model representing this scenario is now proposed. 
1. Deterministic Modeling 

To study the effects of aerodynamic forces on an orbital transfer reentry 
vehicle, the planetary atmosphere in which the flight takes place should be 
modeled. It is convenient to treat the atmosphere as a uniform gas of non- 
varying composition. The effect of the atmosphere on the vehicle is considered 
in terms of the density. There are some important assumptions that have been 
made in order to model the reentry vehicle so that the complexity of the 
problem becomes tractable [1, 2]. 

(a) Assumption of Spherical Symmetry 

A great simplification in the atmospheric modeling is obtained by assuming 
that the atmosphere has a spherical symmetry. However, the true model of the 
system should be represented by oblateness. 
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(b) Assumption of Non- rotating System 

The earth atmosphere which the space vehicle encounters is considered to 
be stationary with zero rotational speed. The rotational effects would depend 
on the latitude of the vehicle at all times. Furthermore, the rotational 
effects would also depend on the inclination of the vehicle's trajectory to the 
equator. However, the simplification of the model is more important than 
including the rotational effects, so these are excluded. 

(c) Assumption of Stationary Atmosphere 

The atmosphere is assumed to be stationary, that is, no winds are 
expressed in the model; also, the time dependence of the parameters is 
neglected. As a result of the above assumptions, the atmospheric density is 
assumed to be exponential and is given by 

P “ Po e '^ H 
where /? is a scale factor. 

With these assumptions in mind, the re-entry model for an aeroassisted 
coplanar orbital transfer vehicle is given by: 

H - Vsiny II. 1 

V - - gsiny - £ II. 2 

m 


v /i \ 

- - ___ ] cosy + 

r 2 / 

r V / 


II. 3 


where 


D 


ps c D V 2 
2 


II. A 
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II. 5 


L - 


pS c L V 


and g is the Newtonian gravitational attraction that is given by 

g “ P/r 2 . 

Furthermore, it is assumed that the drag polar is parabolic, given by 


C D - C D0 + K C L ’ 


II. 6 


Equation II. 6 is valid if we assume no extreme hypersonic conditions, thereby 
allowing independence of the aerodynamic coefficient on the Mach number and the 
Reynolds number [6]. Using normalized variables the equations of motion can be 
rewritten as 

— - bi/siny II. 7 

dr 


di/ 

- - A.b(l 

- C 2 ) S , 2 - 

dr 

1 

(b-l+h) 2 

£7 

— A^b c 5 

v .2 

b v cos 7 b cos 7 

iv + 

dr 

4 *A ^ v V 

<»- 1+h > o-l+h) 2 . 


where 


H/Ha 

b - Ra/Ha 

V ^T 

A r C do S 'r Ha / 2m 

t7 Ra^ Ra/ f 

A 2 ’ C LR S p R Ha/2m 

P/ . 

P R 

°LR -y] W K 

C L / C LR 

C DR " 2 C D0 
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2 . 


Optimization Problem 

For minimum fuel consumption, the performance index is given by 


J - Aiz - Ai/d + d»/ c - <j>[ x(tf) ] 

“V^d" * (l/ o /a d ) COS ( ‘ 7 o ) 


II. 10 
II. 11 


A "c -^7 ' ^f/ a c ^ cos ^f) 11.12 

The atmosphere entry and exit conditions are given by the relationships 

2 ... 2 


(• - 

(* - -<) 


9 

a , - 2ad + u cos* v - 0 
d o o 


2 2 o 

a c - 2ac + cos* y e - 0 


11.13 


11.14 


r £ I £ 

which are the result of applying the principle of conservation of energy and 
angular momentum at the HEO-entry point and exit point-LEO. 

Also, at the entry and exit point we have: 


h(r Q ) - 1 entry 


h(r f ) - 1 


exit. 


11.15 


11.16 


The formulation of the problem falls into the category of a continuous system 
with functions of the state variables prescribed at a terminal time. 

The two constraining functions are: 

tfl - h(rf) - 1 11.17 


/ 2 \ 2 2 

^2 “ [ 2 - v f J a c - 2a c + u f cos 7 f . 


Incorporating these constraints, the performance index becomes 


J - Av c + Ai/{j + nj^i + n2i^2 “ ^ 


11.18 


11.19 


which is referred to as the augmented performance index. 
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The Hamiltonian function is given by 

, 2 * 

H - [bi/siny] + P -A]b(l+C 2 ) 6v 2 - S 7 

L (b-l+h ) 2 


+ P, 


kybcSv + 


bv cos 7 
(b-l+h) 


b cos 7 
(b-l+h ) 1 v _ 


11.20 


where P^, P„, P^ are the adjoint variables. 

The unconstrained optimal control is obtained from the necessary condition 

^ - 0 11.21 

3c 


and the adjoint variables are obtained from 

A _ 3H 
h 


an 

e u ~ 

du 


11.22 


11.23 


P 7 - - _ . 11.24 

3 7 

From equation 11.21 the control is given by 


2 -y 

C - 1 . 11.25 

2A 1 P l/ V 

However, realistically, the control is bounded. The constraint inequality is 
given by 


- C < C < C 


11.26 


max - - max 

where the value of C max is determined by the aerodynamic characteristics of the 
space vehicle under consideration. The Hamiltonian given by equation 11.20 is 
a quadratic function of the control whose second derivative H uu possesses a 
positive definite condition; therefore the strengthened Legendre -Clebsch 
condition 


7 


H uu > 0 


11.27 


is satisfied. This allows us to get the following explicit form of the optimal 


control law [7]: 


C 


C when C > C 


max — max 

C when iCi < C 

I I max 

-C when C < -C 


max — max 


11.28 


Boundary Conditions: 

The boundary conditions due to the nature of the problem are: 


h(r c ) 

- 1 

11.29 

‘'(f’o) 

- specified 

11.30 

l(r 0 ) 

- known 

11.31 

h(rf) 

- 1. 

11.32 


Also there are two terminal constraints given by equations 11.17 and 11.18. 

From the generalized boundary conditions arising from the calculus of variation 
we have [ 4 ] 


P(tf) 


d<t> , T ^ 

_ + n _ 

dx dx 


r - r . 


11.33 


where x - [ h, u t y ] ^ 

D “ [ ni, n2 1 T . 

The six differential equations II. 7 - II. 9 and 11.22 - 11.24 along with the 
three initial conditions 11.29 - 11.31 and three final conditions given by 
11.33, form a two-point boundary value problem with two parameters n^ and n 2 to 
be found in equation 11.33 so that the two constrained algebraic equations 
11.17, 11.18 are satisfied. 

3. Deterministic Perturbation Control 

The perturbation control problem arises when small changes in initial 
and/or terminal conditions require a new computation of the entire control . 
Also, since the actual model state vector £ and control u need to be near 
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the nominal path Xo and Uq, the perturbation variable will preserve the opti- 
mality [9]. Applying the second variation technique a linear feedback control 
scheme can be developed [4] . 

(a) Linear -Quadratic Neighboring-Optimal Control. 

The generation of the perturbation variables Ax, Au arise when the non- 
linear model of part I is linearized along a nominal path by considering small 
perturbations in the initial and/or final conditions. The equations associated 
with the linearized model are: 
state differential equations: 


Ax - f Ax + f Au 
x u 


adjoint variable differential equations: 


AP - -H Ax - f AP - H Au 

XX X XU 


Hxu - £ (H ) T . 

au x 

The perturbed feedback control is: 


Au - -H* 1 (H Ax - f T A£) 
uu ux u 


11.34 


11.35 


11.36 


provided that is not singular in the interval t q < r < r^. The control 
given by equation 11.36 is only valid in the interval where the control 
constraint is not saturated. When the constraint is saturated the state and 
adjoint differential equations are reduced to 



Ax - f x Ax 

• T 

11.37 


AP - -H xx Ax - f x A£ 

11.38 

where 

Au - 0 

11.39 
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The performance criterion is expanded to second order about the nominal 
trajectory. This causes the first-order terms to vanish, that is, the first 
variation AJ vanishes on the optimal (nominal) path. The remaining second- 
order terms constitute what is called the second variation (A 2 J), given as 


A 2 J - i 
2 


A * T (*xx + ( ° T v) A * 


r - r. 


1 p 

2 J r 


[ Ax^ Au^- ] 


H H 


A£ 

XX XU 



H H 


Au 

ux uu 




dr 11.40 


The boundary conditions associated with the neighboring perturbed optimal 
formulation are given by 

Ax(f£) - specified 11.41 


A £(r x ) 



+ (n T tf x ) 


•) 


a* + V> x An 


r - r f 


11.42 


From the terminal constraints on the final states we have 
A* - [ * x AX ] | r _ ff _ 


11.43 


The deterministic model does not explicitly take into account errors 
associated with disturbances inputs acting upon the vehicle (i.e., wind gust 
acting upon the vehicle in the reentry phase) [9]. Furthermore, nothing has 
been said about nonstationary components such as a time-varying wind model 
associated with the plant dynamics. The variational problem needs to be solved 
to determine the perturbed control law Aji(t). The perturbed control Au(t) 
yields the feedback control law that will drive the stochastic differential 
system. 
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III. STOCHASTIC FORMULATION 


The deterministic model is described by equations II. 7 through II. 9. In 
deriving these equations certain assumptions and approximations have been made 
to simplify the model. The addition of white noise to the deterministic model 
implies that there are additional stochastic disturbances that drive the sys- 
tem. Also white noise would accommodate for oversimplifications and approxima 
tions made during deterministic modeling. The stochastic model is given by: 

^ - bi/siivy + W rl III.l 

dr 


d v 
dr 


- Ajb(l + C 2 ) Sv 2 - 


b 2 sin7 

(b-l+h ) 2 


+ W 


al 


III. 2 


- kJacSv + 
dr 


bi/ cos 7 
(b-l+h) 


b2 cos 7 + w 

(b-l+h ) 2 u 


III. 3 


where W^, W^, W ' ^ zero mean white noise processes. More precisely, the 

white noise processes are used to account for the following: 

W rl - accommodates the oblateness term omitted. 

~ accounts for incomplete knowledge of the aerodynamic forces, assumption 
of spherical symmetry, and rotational or Coriolis forces. 

W 0 - same form as W 
a3 a2 
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The process noise also compensates for atmospheric winds acting upon the 
vehicle. Recall the deterministic case where the initial state of the system 
h(r 0 ), i/(r 0 ) and y(r 0 ) was known. We, however, no longer make this assumption 
because the initial state vector can not be measured exactly. The modeling of 
the initial state is assumed to be a vector valued Gaussian random variable, 
its mean and covariance matrix represent a priori information about the initial 
condition of the plant. 

1 . Statistical Description 

The uncertainty in the overall physical process has been modeled in two 
parts . 

(a) Initial uncertainty 

The initial state vector [h(r 0 ), v(r Q ) and 7<r 0 )] T is viewed as a random 
variable. 


(b) Plant uncertainty 

The dynamic equations are driven by mutually independent Gaussian white 


noise processes W^, W^, 

The description of the uncertainty is given as follows. 


The initial state 


vector is Gaussian with known mean and covariance matrix Z Q : 


D 


E I h < r o>» 7(r o ) 


— I I r n 1 

- h , v , 7 (assumed known) 

o o o 


It 


E { |(h(r o ) - h Q ), („(r o ) - * o ), ( 7 (r o ) - 7(> )) 




^(h(T Q ) - h Q ) , (v(t q - u q ), Z o ( assumed known) 
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The plant driving noises W^, W^, ^ ave zero mean and covariance matrix 

9(t) 5 (t-r ) : 



V t > t Q 


E 



6 (t) fi(t - r) (assumed known) . 


The selection of the intensity matrices 0(t) and Zo which govern the strength 
of the uncertainty is discussed in the simulation. 

2. Linearized stochastic modeling. 

The deterministic formulation was based on the nominal state vector 
[h Q (r ) , j/ Q (r) , 7 0 (r) ] T and the nominal control C Q (r) along with the correction 
vector [Ah(r), Ai /(r), Ay(r)]^- and the correction control A C(r). In the 
stochastic modeling we considered the state vectors [h(r), t/(r), 7 (r)]^, 

[Ah(r) , Ai/(r), A 7 (r)]T and the controls C(r) and AC(r) to be random processes 
instead of deterministic. If a Taylors series expansion is made about the 
nominal path by using the model of equations III.l - III. 3, the following 
equation is obtained: 

Ax*(t) - f x Ax*(t) + f u Au*(t) + n(t). III. 4 

Equation III. 4 is a time varying linear state equation. We expect that the 
feedback scheme that generates the control Au* to be of the same form as the 
deterministic feedback control Ay obtained from the second variation. The 
existence of the white noise process in equation III. 4 can be used to account 
for deterministic modeling errors associated with assumptions (a), (b) , and (c) 
of Part II. 1. For example, wind gust acting on the vehicle can be modeled in 
this way. White noise would also compensate for the high order terms that have 
been excluded from equation III. 4. 
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3. Open Loop Feedback Control 

In part II we have investigated the deterministic perturbation control 
obtained from the second variation. The open loop feedback control gains 
and K 2 can be found by solving the linear TPBVP given by: 

A& - f Ax + f Au 
x “ u 


A£ - - H 


XX 


Ax 


f T AP - H Au 

X “ XU 


Au - - H -1 (H Ax - f T AjP) 
“ UU UX U 


where K, - 


H' 1 H , K. 
uu ux 2 


-1 T 

H 1 f A£. 
uu u 


The boundary conditions are: 

Ax(t q ) - specified 


AP(r f ) - 


[(• 


XX 


T 

(n V> ) 

” r X X 


^ Ax + ^ x T An 


r - r f 


A^ - 



r 


r ^ - specified. 


A member of the neighboring optimal correction state and control is deter 
mined by integrating the linear stochastic model 


— — 


— — 


— 

• ★ 

Ah (r) 


Ah*(r) 


ni(r) 

• * 

Ai/ (r) 

- f 

X 

A v* ( t) 

+ f AC* ( r ) + 
u 

n2(r) 

• * 

A 7 (O 


A 7 *(r) 


n3(T> 
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along with the control law 


AC?r) 


K x (r) 


Ah*(r) 

A*/*(r) 

A7*(t) 


+ K 2<'> 


by using initial conditions 


Ah*(r o ) 


Ur Q ) 

- ho(r Q ) 

Ai/*(t ) 
0 

- 

»(T 0 ) 

- «/o(r Q ) 

1 

/*N 

O 

W 

* 

< 

1 


1 

-4 1 
O 

- 7o(r o ) 


III. 6 


III. 7 


Finally a member of the optimal state and control history is evaluated by 


★ 


h (r) 


* . V 


v (r) 

MB 

* , , 


7 (O 


* . . 


C (r) 



ho(r) + Ah (r) 
* 

i/o (r) + Aj/ (r) 
70 (r) + Ay (r) 
Co(r) + AC*(r) 


III. 8 


4. Closed Loop Feedback Control 

In most aerospace and navigational problems a closed loop feedback control 
is very convenient in controlling the plant dynamics and reducing the compu- 
tational time. Recall the linear system given by 

Ax - f Ax + f An, x(r ) - specified 
~ X ~ u o 


with criterion 


15 


a 2 j 


" 2 [* 


T Ky. * <“\>x 




i r r f f . t . t! 

H H 

XX XU 


As 

3 

3 

1 < 

H H 


Au 

z • r _i 

O ! 

ux uu 




dt 


and constraint 




[♦, a *] 


\r - T. 


It is well known [1] that the above system can be replaced by the equivalent 


Ax - Ax + Au, x ( r Q ) “ specified 


with criterion, 


A 2 J 


[»'( 


^XX + ^ ^X^X 


)'* ] I — 


III. 9 


and constraint 


Ajfc 


f r f 

K 
1 

1 

0 


As 

J, 

0 

H 


AH 

y T 

O 

U -I 

_ 

uu 




dr 


• [♦* **] 


where 


t - t f . 


f U) - f - f H' 1 H 
X X u uu ux 


H 


( 1 ) 


.-1 


XX 


H - H H H . 
XX XU uu ux 


III. 10 


III. 11 


III. 12 


III. 13 

The system given by equation III. 9 is found to be controllable by solving the 
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matrix differential equation 


— w (r, r ) 
dt 


T 

f i 1) W(f> r f ) + W(f ’ r f> f ^ 1) 


T 

f f 
u u 


III. 14 


W(r f , r f ) - 0 III. 15 

where W(r Q , r^) is nonnegative definite for > t q [17]. Since the system is 
controllable there exists a control Ajx which drives the state of the system 
given by III. 9 from some initial value X(t Q ) to x(r^) with T f > T Q » We will 
make use of the controllability in the later formulation. 

Next, the performance criterion given by III. 10 is investigated. Recall 
that the necessary conditions for the linear quadratic performance index are: 


*xx + V* j 

>0 


i< x > 

> 

0 

XX 



[ 

uu 

> 

o . 


However, the matrix in III. 13 is not positive semidef inite . To 

circumvent this, we use Schwartz's inequality to bound certain entries of the 
matrix and thereby increase the performance index to be minimized. The 

new matrix thus becomes 

xx 


a 2 H 


ah" 


a 2 H 


du 


a 2 h 


37 
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2 

Recall that Schwartz's inequality is given by | xy | < | x | • | y | . Thus, 

the physical meaning of taking the absolute value implies that we are 
minimizing both positive and negative deviations from the nominal path. 

Solving the differential equation III. 14 along with III. 15 we see that the 
system is still controllable. The closed loop feedback control is given by 
[4] 

Au<r) - - h’* ^ U T (S - RQ ' 1 R T ) Ax(r) + f^RQ ' 1 Atf J 

where 


S - - Sf 


( 1 ) 


cTl) 


-1 •£ 

S + S f H f 
u uu u 


H 


( 1 ) 


XX 


III. 16 


S(r f ) 

R - 


R(r f ) 



+ (n \>x 


-1 

S f H 
u uu 




T 

f l ) R 
u 




III. 17 


III. 18 


III. 19 


Q 


-1 


f H 


u uu 



III. 20 


Q(r f ) - 0 . 


III. 21 


Since Che system is controllable, we can force the terminal constraints 

Aip — rf> Ax I - 0. 

I r - ff 

From equation III. 16, the closed loop feedback control law is given by 

Au(r) - - H 1 f T ( S - RQ* 1 R T ) As r < r < r_. III. 22 

uu u o- f 
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The sufficient conditions for the existence of a neighboring solution are 
[4] 

H uu > 0 

Q(r) < 0 

S(r) - R(r ) Q* 1 ^) R T (r) finite for t q < r < r f . 

As in the case of open loop feedback, a member of the neighboring 
correction state and control is determined by integrating the linear stochastic 
model given by equation III. 5 with the control law given by equation III. 22. 

The initial conditions are given by equation III. 7. Again, a member of the 
optimal state and control history is evaluated by equation III. 8. However, in 
the case of real-time control, the physical system is the one that provides the 


integration[3] . The neighboring optimal control is computed as a 

function of the difference between the measured state j^h n (r), i/ m (r), y m (r) J 

T 

and the nominal optimal state j^h 0 (r), i/ 0 (r), 7 0 (r) J • The optimal control 
is defined as 


* -It 

AC (r) - - H f ( S - RQ 
uu u 


1 R T ) [ 


h - h , v 
o m o 


v , 7 - 7 

m o m 


Therefore, the total optimal control is 


C*(r ) - Co(r ) + AC* ( r ) . 


5. Evaluation of the Variational Cost Function 

The deterministic non-linear cost function and the second variation cost 
are given by equations II. 10 and 11.40, respectively. 

The stochastic cost of the variational performance index can be expressed 
as a trace of the expected values of the second variational cost given by 
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A 2 j* - - Tr 


[ 


Ax* T (<f> + (n T ^ ) ) Ax* 

XX - XX 


]l.-„ 



III. 23 


If we assume Chat the combined optimization of the nominal trajectory and the 
perturbation stochastic feedback control is given by 


min 


( J + A 2 J* 
nom 



min Jnom 




noise - 0 


+ min 



III. 24 


we can determine the total minimum cost required. 

In the presence of noise, it is impossible to meet the terminal condition 

[ x(r f ) , rf ] - 0 exactly. Hence, in the place of the requirement 

A^> - V>x Ax | - 0 the quadratic approximation of the noisy case is 

- r f 

T 

augmented by N where N is diagonal positive definite matrix [4] . 
Equation III. 23 is replaced by 


A 2 J* - 1 Tr 




Ax* T (<f> + ) x + N ^ ) Ax* 

XX X X X X 




+ E 



H 


* “ 

XU 


A* 

* 

H 


Au 

uu 





L- -J 
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In the case of the closed loop feedback control, the performance index becomes 



which is simplified to 



Finally, since Au* - - H uu f ^ ( S - RQ‘1 R T ) Ajc* 

we obtain C--H f T (S- RQ" 1 R T ) 

uu u 

U - C X C T . 
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IV. NUMERICAL DATA AND RESULTS 


The data used for simulation are summarized below: 


Spacecraft data 


m/s — . 3E03 kg/m 3 


C 


DO 


.21 


K - . 167E01 
C LR “ - 3546 


CL 

max 


.9 


Physical data 

fi - — 

6900 

P o - 1.316 

R - . 6498E07 
a 

R - . 6558E07 
c 

R d - . 12996E08 
H - . 3986E15 


Normalized values 


Rr - . 6498E07 

m 

Hr - 120.0E03 

— 

Vr - 7.832 

m/sec 

t R - 887.16 

sec 

P R - . 3996E-2 

kg/m 3 


m'l 

kg/m 3 

m 

m 3 /sec2 
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Using the above mentioned data, simulations are carried out for two cases 
of nominal solutions. The nominal (optimal) solutions of the deterministic 
non-linear TPBVP and neighboring linear TPBVP are obtained by successful use of 
OPTSOL code developed by Deutsche Forschungs - and Versuchsanstalt fur Luft 
Raumfahrt (DFVLR) at Oberpfaffenhofen, West Germany. 

1. Deterministic Solution 

The nominal solution is obtained by solving a TPBVP. The time histories 
of altitude H, velocity V, flight path angle 7 , and the control coefficient Cl 
for two cases are shown in Figures 3 and 4. The flight time through the atmo- 
sphere for the two cases is 480 and 550 seconds, respectively. Using the 
physical data given above, the following entry and exit conditions are 
obtained. 

Case #1 

Entry: He - 120 km; Ve - 9.025 km/s; 7 e - 6.14* 

Exit: He - 120 km; Ve - 7.459 km/s; 7 e - -0.025® 

Characteristic velocities: 

Deorbit velocity, AV<j - 1.05387 km/s 
Reorbit velocity, AV C - .405493 km/s 

Case #2 

Entry: He - 120 km; Ve - 9.029 km/s; ye - 5.665® 

Exit: He - 120 km; Ve - 7.666 km/s; ye - 0.302® 

Characteristic velocities: 

Deorbit velocity, AV^ - 1.04565 km/s 

Reorbit velocity, AV C - .20083 km/s 

Consider the optimal solution obtained for case #1. Initially, the 

vehicle is in a circular orbit at HEO moving at a speed Vd - -yV^d “ 5538.14 
m/s . A deorbit impulse AV^ - 1053 . 87 m/s is executed to fly the vehicle 
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through an elliptic orbit. The elliptic velocity at the deorbit point D is 
V(j - V(j - AV<j - 4484.27 m/s. At the atmospheric entry point E of altitude 
H a - 120 km, the vehicle attains an orbital velocity Ve - 9.025 km/s. During 
the atmospheric maneuver, the velocity of the vehicle is reduced and the exit 
velocity is Vf - 7.459 km/s. In order to attain the desired circular orbit 
(LEO) at radius R c - 6558 km, a reorbit impulse AV C - 405.49 m/s is imparted. 
The vehicle is now in a circular orbit with speed V c - yj M /R c - 7796.2 m/s - 

V c + AV C where V c - 7390.71 m/s which is the elliptic velocity along the exit- 

LEO elliptic path. 

The simulation of equation III. 5 is obtained for different strengths of 
white process noise. The criterion used is based on the assumption that the 
cost resulting from the deterministic optimization mindset should be 
sufficiently larger than the optimization resulting from the stochastic 

2*1 

contribution of the cost, min EA J 
2 . Open Loop Feedback Control Law 

Here the neighboring-optimum optimization technique was applied along a 
nominal trajectory obtained from the nonlinear TPBVP. Then, the linear 
stochastic differential equation was implemented to generate a set of optimum 
trajectories for slightly different initial conditions and state covariance 
matrices. The optimum trajectories of altitude, velocity flight path angle and 
lift coefficients are shown for three different sets of data (set #1, Set #2, 
and Set #3). Note that the state vector does not converge to the nominal path 
as time is increased. 
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3. Closed Loop Feedback Control Law 

Here the control scheme was applied by first solving the three Riccati 
type equations backward in time. Then, the linear stochastic differential 
equation was solved by considering different sets of initial conditions. This 
scheme is significantly important in terms of computational time required to 
solve the overall problem. Note that the control scheme works better for 
A7(r G ) < 0 than for Ay(r 0 ) > 0. The gain values become very large when Ay(r 0 ) 
is greater than zero. Also the correction components of altitude velocity and 
flight path angle converge to zero as time approaches the final time. Better 
results are also obtained in terms of a stochastic cost which is less for 
Ay(r 0 ) < 0 than for A-y(T 0 ) > 0. The optimum trajectories of altitude, 
velocity, flight path angle and lift coefficient are shown for six sets of 
initial conditions (Set #4 - Set #9). 

Due to the digital computer simulation, the small magnitude of the numbers 
required some scaling. The scaling coefficients of the standard white noise 
processes are Lj_, L 2 , L 3 . The covariances of the noise W r ^, W a ]_, W a 2 are Q^, 
Q 2 , Q 3 , respectively. The initial conditions used to generate the state and 
control trajectories are shown in Table 1, Table 2 and Table 3. 
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V. CONCLUDING REMARKS 


In this report, we have devised a stochastic neighboring optimal guidance 
scheme as applicable to an AOTV. We have addressed the minimization of fuel 
consumption during the atmospheric portion of an aeroassisted, coplanar, 
orbital transfer vehicle, and examined the effects of uncertainties due to 
modelling on the neighboring optimal guidance. In the first stage, a nominal 
solution has been obtained for the deterministic, nonlinear dynamics 
describing the atmospheric maneuver of a coplanar AOTV. In the next stage, a 
neighboring optimal guidance has been determined. In the third stage, with a 
linear stochastic model, a neighboring optimal solution has been obtained. 
Finally, the approximate solution has been obtained as the sum of the 
deterministic nominal solution and the stochastic neighboring solution. 

Numerical results have been presented for a typical coplanar AOTV. 

Control trajectories are achieved by means of lift modulation. The 
performance index minimized is in terms of energy required for orbital 
transfer. It has been shown that the overall cost is increased when the 
deterministic and stochastic minimal problem is combined and lower and upper 
bounds on the control have been imposed. 

The space vehicle is assumed to have a digital computer on board so that 
different nominal trajectories are stored. Whenever the vehicle desires to 
enter the atmosphere, a nominal trajectory is used along with the desired 
initial conditions so that the linear stochastic differential equation is 
implemented. The results obtained are used as a correction to the nominal 
trajectory. This approach reduces the computational time and the requirement 
of large computers on board the vehicle. It also takes into consideration the 
uncertainty associated with the inexact knowledge of the true model describing 
the flight through the atmosphere. 
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Table 1 


LI 

L2 

L3 

Q1 

Q2 

Q3 

A £(r 0 ) 
A*(r 0 ) 

A* ( r o ) 


- Set , #; 

1 E-5 
1 E-4 
1 E-4 
1 

30 

55 

12m 

46.99 m/s 
0 . 06* 


-Set.. # 2_ 

5 E-5 
1 E-4 
5 E-4 
1 

30 

55 

36m 

39.6 m/s 
0.0573* 



" 4E-8 0 0 _ 


" IE-7 0 0 " 


0 5.4E-4 0 


0 IE-4 0 


0 0 2E-5 


0 0 IE-4 



^det 


1459.36 m/s 


1459.36 m/s 


a2j* 


74.69 m/s 


126.07 m/s 


Note : The covariance matrix 



is given in a normalized form. 


Set #3 

1 E-5 
1 E-4 
1 E-4 
1 

30 

55 

36m 

156 m/s 
0.173° 

0 0 " 

IE-5 0 

0 IE- 5 

1459.36 m/s 
12.53 m/s 
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Table 2 


LI 

L2 

L3 

Q1 

Q2 

Q3 

Ah(r 0 ) 

A*(r 0 ) 

A*(r 0 ) 



^det 

A 2 J* 


Set #4 

1 E-5 
1 E-4 
1 E-4 
1 

30 

55 

12m 

46 . 99 m/s 
0.057° 

4E-8 0 0 “ 

0 1.2E-4 0 

0 0 2E-5 

1459.36 m/s 
212 m/s 


Set #5 

1 E-5 
1 E-4 
1 E-4 
1 

30 

55 

60m 

39.16 m/s 
0.057° 

4E-10 0 0 “ 

0 7.5E-7 0 

0 0 IE-8 

1459.36 m/s 
131.39 m/s 


Set #6 

1 E-5 
5 E-4 
5 E-4 
0.1 
3 

5.5 

120m 

70.49 m/s 
.458° 

" 4E-10 0 0 “ 

0 7.5E-7 0 

0 0 2E-7 

1459.36 m/s 
329.33 m/s 
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Table 3 


Set #7 Set #8 Set #9 


LI 


1 E-5 


1 E-5 

1 E-5 

L2 


1 E-4 


1 E-4 

5 E-4 

L3 


1 E-4 


1 E-4 

5 E-4 

Ql 


1 


1 

1 E-l 

Q2 


30 


20 

5 

Q3 


55 


30 

5 

A&(r 0 ) 


1.2m 


120m 

96m 

A *(r 0 ) 
A*( r o) 


0.39 m/s 
2.86 E-3* 


39.16 m/s 
-0.286* 

7.83 m/s 
-0.516* 

[x* T | 

r - r Q 

" 1E- 
0 
0 

8 0 0 “I 

IE-7 0 
0 1.5E-7 

" 5E- 
0 
0 

•8 0 0 “I f 1E * 10 

5E-7 0 0 

0 7.5E-7 0 

0 O' 

5E-7 0 

0 1.05E-6 

^det 


1246.47 m/s 


1246.47 m/s 

1246.47 m/s 

A2j* 


91.41 m/s 


51.69 m/s 

214.29 m/s 
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Fig. 3 Stochastic Simulation Diagram: Closed Loop 
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Fig. 4 Nominal Solution: Case 1 
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Fig. 7 Stochastic Simulation: Open Loop: Set # 2 
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Fig. 8 Stochastic Simulation: Open Loop: Set # 3 
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Fig. 9 Stochastic Simulation: Closed Loop: Set # 4 
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Fig. 10 Stochastic Simulation: Closed Loop: Set # 5 
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Fig. 11 Stochastic Simulation: Closed Loop: Set # 6 
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Fig. 12 Stochastic Simulation: Closed Loop: Set # 7 
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Fig. 13 Stochastic Simulation: Closed Loop: Set # 8 
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Fig. 14 Stochastic Simulation: Closed Loop: Set # 9 










VII. APPENDIX 


Costate variable differential equations for the nonlinear TPBVP. 


P, - - p 
h v 


2 2 ^ H a 

» a b (1 + c ) v e a + 


2b 2 sin 7 
(b-l+h) 3 


+ P 


-/ 9 h H . 

Q „ A v a , Dl/ COS 7 

p H A 0 b c e + L 

a 2 2 

(b-l+hr 


2 b COS7 
(b-l+h) 3 i/ 


p - - p, 
v h 

bsin7 

+ p 

V 

2 *^ H a h 

2 A x b (1+c ) e a 1/ 


_ _ 


_j 


A£bc e 


-£h H , .2 

a + b cos 7 b cos 7 

(b-l+h) (b-l+h) 2 i/ 2 


• 



P - - P. 
7 h 

bi/cos7 

+ p 

1/ 


.2 

b cos 7 


(b-l+h) 4 


+ P 


b i/ sin 7 b sin 7 

(b-i+h) (b-l+h) 2 !/ 


A-l 


VI. 1 


VI. 2 


VI. 3 



Equation associated with the linearized TPBVP are as follows: 


State equations: 

Ax - f A x + f Au 

X “ U " 


VI. 4 


where f 

x 


a Jh 

3h 

3v 

37 


0 


b sin 7 


bi/ cos 7 


^1 

1 

1 


1 

i 


1 

CM* 

t 

3h 

3v 

37 


3c 

at 

af 

af 


a f 

V 

V 

V 

f - 

V 

ah 

3v 

37 

n 

3c 

at 

af 

af 


af 

7 

7 

7 


7 

ah 

av 

37 


3c 

_ 


_ 


_ 


3f 

v 

3h 

3f 

v 

du 

df 

v 

d 1 


Ajb C D " (l+c 2 ) P Ha 6 V 2 + 2 b stn 1 

(b-l+h ) 3 

-2 A x b C D " (1+C 2 ) 6v 

.2 

D COS 7 

(b-l+h ) 2 


A-2 



3f 


7 _ 


ah 


A- 0 H b C &v 

/ 3 . 


bu cos 7 
(b-l+h ) 2 


+ 2 


b cos 7 
(b-l+h) 3 */ 


df 

dv 


’..HI ♦ b cos 2 + b 005 I 


(b-l+h) 


2 2 

(b-l+h) V 


3f V • ,2 • 

7 _ b w sin 7 b sin 7 


d-y 

'Jl 

dc 


(b-l+h) 


- 0 


(b-l+h) 1 / 


3f 

dc 


2 - -2 A. b C_ c 5 1 /^ 
1 Do 


8f 


dc 


b Si/ 


Adjoint variable dif. equations: 


AP 


Hxx A x - f x A P - H xu Au 


where 


H - 

xx 


ah 

a 2 « 

a 2 H 

ah 2 

aha*/ 

aha 7 

2 

2 

2 

a h 

a h 

a h 

dt/dh 

a */ 2 

di/dy 

2 

2 

2 

a h 

a h 

d h 

373 h 

373*/ 

dy 2 


H 



a h 

3H 

3H 

, H - 

a^H 

3 2 H 

a 2 h 


ah 

du 

a 7 

XU 

3u3h 

dudi / 
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A-3 



a 2 H 


ah 


2 

2 226 b sin y 

A x ( fi Ha; b C Dq ( 1+0 a »/ - — 

(b-l+h) 4 


2 

, „ , x 2 , 2 b i/ COS7 6 b sirvy 

A2 ( P Ha) be 61/ + ■ 

(b-l+h) 3 (b-l+h) 4 i/ 


£!l 

aha*/ 


2 Ajb C Dq ( 1+0 /J Ha 6u 


P + 

V 


- Aj b c ^ Ha i 


b cos 7 2b cos 7 


(b-l+h) 2 (b-l+h) 3 »/ 2 


a 2 H 

0 V 2 

2 b C0S7 

P 

+ 

b 1/ sirry 

2 b 2 sin7 

aha 7 

(b-l+h) 3 

V 


(b-l+h) 2 

(b-l+h) 3 v 


a 2 H 


dv 


2 A x b C Dq (1+C ) 6 


P + 

V 


2 b COS7 

2 3 

(b-l+h) v 


a^H_ 

3^7 


[bcos7] P^ + 


b v sin7 
(b-l+h) 


b 2 sin7 
2 2 

(b-l+h) 1/ 


A -4 
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3 7 


[ -bi/siivy] + 


b^sin7 
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b v COS 7 


.2 

b C 0 S 7 


(b-l+h) (b-l+h) »/ 


3 2 H 

3c3h 


“ [2 A l b C Do C * H a 6 V ] ? u + 1 ‘ A 2 b P , 


dcdu 


( ' 4 A l b C Do C 5 "1 P „ + !A 2 » «1 P 


£!l 


The perturbed feedback control is given by 


Au - -H ' 1 (H A x + f T AP) 

UU UX U - 


VI. 6 


where 


H - - 2 A.b C_ 5 v P 

uu 1 Do v 


Ac - 


c 0 H 




A.b H P 
2 a 7 

2 A. C_ 1 / P 
1 Do 7 


A 2 P t 

2A l C D»‘' 2p , 


A P, 


AP 





A, 

+ 

c 

AP + 
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p 

1 / 

1 / 

2A.C_ y P 
1 Do 7 


— — 


— _ 
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The boundary conditions are: 




[V» x A x] 


f - r, 


Ah(r 0 ) - specified 
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VI. 8 
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Abstract: The fuel-optimal control problem in aeroassisted noncoplanar orbital 
transfer is addressed. The equations of motion for the atmospheric maneuver 
are nonlinear and the optimal (nominal) trajectory and control are obtained. 

In order to follow the nominal trajectory under actual conditions, a 
neighboring optimum guidance scheme is designed using linear quadratic 
regulator (LQR) theory for onboard real-time implementation. One of the state 
variables is used as the independent variable in preference to the time. The 
weighting matrices in the performance index are chosen by a combination of a 
heuristic method and an optimal modal approach. The necessary feedback control 
law is obtained in order to minimize the deviations from the nominal 
conditions. 


Nomenclature 

A = C Sp H /2m 

1 DO s a' 

A = C Sp H /2m 

2 LR K s a' 

b - R /H 

a' a 

C D : drag coefficient 

C : zero-lift drag coefficient 

DO 

C L : lift coefficient 

C : lift coefficient for maximum llft-to-drag ratio 

LR 

D : drag force 

g : gravitational acceleration 

H : altitude 

h : normalized altitude 

K : induced drag factor 
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lift force 


L 

m : vehicle mass 

R : distance from Earth center to vehicle center of gravity 

R : radius of atmospheric boundary 

a 

R : radius of Earth 

E 

S : aerodynamic reference area 

t : time 

V : velocity 

v : normalized velocity 

0 : inverse atmospheric scale height 

y : flight path angle 

i p : heading angle 

<r : bank angle 

0 : down range angle 

# : cross range angle 

5 : normalized density 

p : gravitational constant of Earth 

•») = normalized lift coefficient 

p : density 

p : density at the sea level 

x : normalized time 
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I. INTRODUCTION 


In space transportation system, the concept of aeroassisted orbital 
transfer opens new mission opportunities, especially with regard to the 
initiation of a permanent space station [1], The use of aeroassisted maneuvers 
to affect a transfer from high Earth orbit (HEO) to low Earth orbit (LEO) has 
been recommended to provide high performance leverage to future space 
transportation systems. The aeroassisted orbital transfer vehicle (AOTV), on 
its return journey from HEO, dissipates orbital energy through atmospheric 
drag to slow down to LEO velocity. Thus, the basic idea is to employ a hybrid 
combination of propulsive maneuvers in space and aerodynamic maneuvers in 
sensible atmosphere. Within the atmosphere, the trajectory control is achieved 
by means of lift and bank angle modulations. Hence, this type of flight with a 
combination of propulsive and nonpropulsive maneuvers, is also called 
synergetic maneuver or space flight. 

Guidance is the determination of a strategy for following a nominal 
flight in the presence of off-nominal conditions, wind disturbances, and 
navigation uncertainties [2-5]. There are two fundamentally different 
approaches for guidance of spacecraft through the atmosphere. 

(i) Predicted Guidance: Here, we predict future trajectories at the 
required point of time by either fast computation or use of approximate closed 
form solutions. In prediction using fast computation, the governing equations 
are solved by an air-borne computer to determine all possible future 
trajectories. The main advantage of this type of prediction is the ability to 
handle any possible flight condition and accommodate large off-nominal 
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conditions. The principal objection to the system Is the requirement of large 
onboard computer. On the other hand, for the onboard prediction of 
trajectories, the closed form solutions are very simple and convenient for 
Implementation. In most of the cases, the closed form solutions are obtained 
based on approximate techniques. Thus, the trajectories are obtained typically 
for constant altitude, constant deceleration, and equilibrium glide paths. 
Guidance using approximate closed-form solutions has the disadvantage of not 
having the flexibility to handle enough off-nomlnal conditions. 

(ii) Nominal Guidance: In this scheme, the nominal trajectories are 
precomputed on ground taking Into all the aspects of constraints with 
optimization and stored onboard. During the flight, the difference between the 
measured values and nominal (stored) values is used In guiding the vehicle 
onto the nominal trajectory (path controller) or generate a new trajectory to 
reach the destination (terminal controller). Here, the nominal trajectory 
being fixed on the ground, does not take Into account any contingencies 
arising during the flight. 

In a typical guidance scheme, the final steering command Is generated as 
the sum of two components, an open-loop actuating (control) signal yielding 
the desired vehicle trajectory in the absence of external disturbances, and a 
linear feedback regulating signal which reduces the system sensitivity to 
unwanted Influences on the vehicle. It Is well known that the closed-loop 
system Is stable about the nominal trajectory and has additional desirable 
features. 

In this report, we address the fuel-optimal control problem arising in 
noncoplanar orbital transfer employing aeroassist technology. The maneuver 
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involves the transfer from HEO to LEO with a prescribed plane change and at 
the same time minimization of the fuel consumption. It is known that the 
change in velocity, also called the characteristic velocity, is a convenient 
parameter to measure the fuel consumption. For minimum-fuel maneuver, the 
objective is then to minimize the total characteristic velocity for deorblt, 
boost, and reorbit (or circularization). The corresponding optimal (nominal) 
trajectory and control are obtained. The linearization is performed around the 
nominal condition and the resulting model is fitted into the framework of 
linear quadratic regulator (LQR) theory. Instead of using time, one of the 
state variables is employed as an independent variable, thus avoiding any 
control required due to irrelevant timing errors. Also, the elimination of 
time as an independent variable carries with it the advantage of order 
reduction for the system. The choice of weighting matrices in the performance 
index is made by combining a heuristic method and optimal modal control 
approach. The feedback control law is obtained to suppress the perturbations 
from the nominal condition. The results are shown for a typical AOTV. 
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II. FORMULATION OF THE PROBLEM 


The basic equations for orbital transfer from HEO to LEO, are those for 
deorbit, aeroassist (or atmospheric flight), boost and circularization (or 
reorbit). But, for guidance and control purposes, we consider only the 
atmospheric flight during which phase the vehicle needs to be controlled by 
aerodynamic lift and bank angle to achieve the necessary velocity reduction 
and the plane change. 

Consider a vehicle moving about a nonrotating spherical planet. The 
atmosphere surrounding the planet is assumed to be at rest, and the central 
gravitational field obeys the usual inverse square law. The equations of 
motion for the vehicle are given for kinematics as [6], 

dQ 

— = Vcosycos^/Rcostp (la) 


^ = Fcosysini/f /R 
57 = Vsln * 

The force equations are 
dV 

njjjj- = - D - mgs l nr 

= ^cos <r + m(V?R - g ) cosy 

mV^- = Lsintr/cosy - (mV?R) cosycosi&tanA 
at 

where , 


(lb) 

(lc) 

(l d) 

(le) 

(l f) 


7 


L = CoSV 2 / 2; D = C pSV 2 / 2; C = C + KC 2 

L D D DO L 

g = fi/K 2 ; R = H + R £ ; p = p^expi-HP) 

Using the normalized variables, 

T = t/J^/p; v = V/Vp/R^ 

and the dimensionless constants, 

h - H/H \ b = R /H ; 5 = p/p = exp(-hpH ) 

a a' a s a 

c u,-'T 5 o7 s 

in (1), we get the normalized form as 


dd _ bv cosycosift 
dr ~ (b-l+h)cos0 


d<p bvcosys 1 ni/i 

dx (b-2+h) 


dh 

dx 


dv 

dx 


= bvsiny 
= - A b(l+v a )6v a 


b 2 slny 

(b-l+h) 2 


dy 

dx 


= / bySvcostr + 
2 


bvcosy 

(b-l+h) 


u 2 

b cosy 
(b-l+h) 2 v 


d\p _ ^gk^Ttvslno* ^ bvcosycosi/»tan0 
dx - cosy (b-l+h) 


where, i4 = C Sp H /2m; 

1 DO s V 


4 = C Sp H /2m 

2 LR K s a' 


( 2 ) 

(3a) 

(3b) 

(4a) 

(4b) 

(4c) 

(4d) 

(4e) 
(4f ) 
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Taking the performance Index as the sum of the characteristic velocities 
for deorbit, boost, and recircularization, the above fuel-optimal problem is 
solved by using a multiple shooting method. This is the nominal (optimal) 
solution to be used in obtaining the guidance scheme [7], 

However, under the actual flight conditions, the Initial conditions may 
not agree with those assumed for generating the nominal trajectory and more 
important the vehicle may not follow the nominal trajectory due to various 
disturbances. Hence, rather than compute a new nominal trajectory each time 
some disturbance is encountered, it is proposed to implement a closed-loop 
control of the vehicle to compensate for the deviations from the nominal 
condition. 

(a) Selection of Independent Variable 

In a typical guidance problem, the vehicle is required to follow a 
specified (nominal) trajectory in three-dimensional space. Suppose, the actual 
vehicle at a particular time is on the nominal trajectory, but much earlier 
than required or reached the desired point at incorrect time. The exact time 
at which the vehicle reaches the various points on the trajectory may be of no 
concern. Thus, if the actual trajectory satisfies the spatial relationship of 
the desired (nominal) trajectory, but the vehicle travelled more slowly or 
more quickly, the regulator (designed with time as Independent variable) would 
sense these timing errors as spatial (state) errors along the trajectory, 
although, in fact, these are errors of no relevance to the objective of the 
guidance [2-4]. Based on these spurious errors, the regulator tends to "over 
control" the system and thus wastes considerable amounts of control effort. 
Because time is used as the independent variable in the regulator design, not 
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only does the regulator try to follow the desired path, but it tries to force 
the system to follow at a particular rate. 

The LQ regulator can be made significantly more robust by the simple 
technique of using a trajectory (state) variable instead of time as the 
independent variable. Also, if one is concerned only with the relationship 
that should exist between the system trajectory variables on the desired path, 
one of the state variables could be used in place of time as the independent 
variable. The main appeal for this change of the Independent variable lies in 
the fact that inherently state dependent events become time-dependent events 
in an indirect manner. Another obvious advantage of eliminating time as the 
independent variable is simply the reduction in the order of the mathematical 
model of the system. 

In the present plane charge problem, the down range 0 is monotonic and 
is a good cardidate for an independent variable. Thus, the system of equations 
(4) with time as Independent variable is converted into the following system 
of equations with down range 0 as the independent variable. 


— = (b-l+h)tanrcos0/cos^ 


= -A (l+T) Z )Sv(b-l+h)cos^/cosjcosifi 

Uo 1 

■jk - A 5T)(b-I+h)cos«rcos0/cosycos0 

uU 2 

^ = cos^tan^ 


(5a) 


(5b) 


(5c) 


(5d) 
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(5e) 


= / 2 57)(b-I+h)sin<rcos^/(cosr ) 2 cos^r 

where, 5 is a function of h, and the controls are normalized lift coefficient 
t ) and bank angle c r. In the above equations, a valid assumption that the 
gravity and centrifugal forces are negligible compared to either lift force or 
drag force is used in order to get a simplified form of equations. Also, note 
that the order of the system (5) is now only five compared to the sixth order 
system (4). 

(b) Linearization 

The nonlinear equations of motion (5) are represented in a compact form 
as 

x = f ( x, u) (6) 

T T 

where, x = dx/dQ, the state vector x = [h, v, y,0, ip] and the control vector u 

= [i>, <r] . Let the system (4) represent the nominal (optimum) trajectory and 

control which we are Interested In flying. The optimization results In an 

open-loop Implementation. Unfortunately, the open-loop guidance tends to be 

very sensitive to external disturbances and the vehicle parameter changes. In 

an actual situation, the system equations may differ from reality due to 

various assumptions made In deriving them. Consider the perturbations as 

x = x + Sx; u = u + 5u (7) 

o o 

where, [x , u ], and [x, u] represent nominal and perturbed conditions 

O O 

respectively, and [Sx, Su] represent the deviations from the nominal 
condition. 
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If we aim at the guidance laws that meet the performance specifications 
in the presence of off-nominal conditions, it is natural to seek the 
principles of linearity and feedback. Then, it is well known that the 
perturbed system satisfies the linear system [8] 


5x ■ A6x + B5u (8) 

where, A * 3f/3x, and B = 3f/3u, are evaluated along the nominal trajectory. 
Although the matrices A and B can be evaluated for all values of interest, it 
may sometimes be necessary to keep A and B constant between the intervals of 
updating. The errors due to this quantization procedure are assumed to be 
small enough so that no drastically different changes occur in the 
performance. Keeping A and B constant also enables us to use the 
time- invariant version of the Riccati equation in the regulator problem. 
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III. NEIGHBORING OPTIMAL GUIDANCE 


The basic regulator synthesis problem Is that of selecting a control 
policy which generates Su in such a way that [Sx, 5u] are made as small as 
possible [8]. The performance Index Is 

j r“ 

J = i|[5x T (?5x + 6uR8u]de (9) 

^ J o 

where, the first and second terms under the Integral represent the penalty 
from the nominal state and control vectors respectively. The matrix R must be 
positive definite, while Q must be positive semidef inlte. These weighting 
matrices are usually symmetric and diagonal to minimize the number of 
parameters to be chosen. 

It is shown that the omission of second order terms in getting the 
linearized equation (8) Is Justified by selecting the performance index (9) 
with quadratic character. Using the minimization procedure, the feedback law 
is obtained as 

5u = - F8x (10) 

Where F = R~ 1 B r P and P is the positive definite, symmetric solution of the 
matrix Rlccatl algebraic equation 

PA + A T P - PBR~ 1 B T P + (? = 0 (11) 

The linear optimal control theory results In a feedback law which 
computes corrections to the nominal commands as shown In Fig. 1. 
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Desirable Features of LQR Guidance 


(1) The closed-loop optimal control Is linear. 

(ii) The control is easy for implementation or mechanization. 

(iii) The closed-loop system using the optimal control is asymptotically 
stable. 

(iv) The closed-loop control is robust in the sense that, if the system 
contains additional white-noise terms which model turbulence, atmospheric 
inhomogeneities, and unmodelled high-frequency vehicle dynamics, the 
closed-loop control will still give the control policy which minimizes the 
expected value of the performance index. 

(v) The closed-loop system possesses attractive sensitivity properties with 
respect to variations in the elements of A and B. 

sense that the feedback 
in advance and stored for 

implementation onboard. 


(vi) The guidance scheme is off-line, in the 
coefficient matrix F (= R 1 B T P) is calculated 
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IV. SELECTION OF WEIGHTING MATRICES 


Guidance requirements during the atmospheric maneuver demand good nominal 
path following, and small errors under a variety of perturbations and 
off-nominal conditions. The designer must be able to come up with a set of 
weighting matrices Q and R that satisfy these specifications. In general, there 
is no simple and systematic way of selecting these matrices. 

As Q is increased, the penalty for deviating from the nominal trajectory 
is increased if R is unchanged. The resulting trajectory tends to be closer to 
the nominal trajectory, but at the expense of greater control requirements. 

When R is lau'ge, which means the cost of control is Important, the states 
decrease slowly. As R decreases, the control becomes quite lau'ge. 

The proper selection of weighting matrices calls for physical auid 
engineering intuition and simulation experience with different trial runs. 
However, there are some techniques available for chosing the weighting matrices 
[ 9 ] . These au*e 

(1) Heuristic Methods 

(ii) Optimal Modal Control Methods 

(iii) Asymptotic Optimal Root Loci Methods 

(iv) Dynaunic Weighting Methods. 

(i) Heuristic Methods 

One of the heuristic methods is the ’ lnverse-squau'e method’ ba^ed on 
rule-of-thumb [10]. This is still a widely used method for the selection of 
quadratic cost matrices. The basic idea is the normalization with respect to 
their expected maximum values. Also, in most practical applications, the 
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matrices Q and R are selected to be diagonal so that specific components of 
the state and control perturbation vectors can be penalized individually. 
Thus, 



0 


0 


0 



R 



( 12 ) 


(ii) Optimal Modal Control Methods 


The modal control approach Is to determine a state feedback law u = -Fx, 
so that the closed-loop system matrix D(- A-BF) has a prescribed set of 
eigenvalues [11]. Optimal modal control Is based on the conventional 
pole-placement technique, but, Instead of choosing the feedback matrix F(= 

R B P) directly, the weighting matrices of the performance index in linear 
quadratic regulator problem, are chosen to achieve the objective of placing 
the eigenvalues at the desired locations. The problem Is to find the state 
weighting matrix Q for a given control weighting matrix R that corresponds to 
a set of prescribed eigenvalues. The method Is based on transforming the given 
linear system Into a diagonal (decoupled) system. The approach uses explicit 
formulas relating the elements of the state weighting matrix, the actual and 
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the desired eigenvalues. 


In the modal control approach, the choice of feedback matrix F Is not 
unique, so that there may be a number of weighting matrices giving the same 
closed-loop eigenvalues. However, the method Is easy for computer 
implementation. The details of the method are omitted and only the algorithm 
Is given below for the case of real eigenvalues [11]. 


Algorithm 


Step 1: Initialization (1=0) 

Given the system matrices A, and B and the weighting matrices Q, and R, we 
obtain the optimal feedback matrix F using LQR theory. 

Step 2: Loop 

Obtain the system matrix D ■ A - BF ^ 

Step 3: Elgenvalues/elgenvectors 


(I) Compute modal (eigenvector) matrix H ' = [v^ iM 

-1 T 

(II) Compute diagonal matrix = M ^ 

(III) Compute matrix H = H^ 1 BR~ 1 B T mJ 


Step 4: Update 1 = 1+1 

Step 5: Shifting of eigenvalues 

The actual eigenvalue A Is to be shifted to the desired position A . 

aj <*J 

Compute, 



( 13 ) 
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Step 6: 


Form Q i = diag |o, 0, . . . , ^ J ,0, . . . , 0 j 

Step 7: Matrix Rlccati equation 

Using Q from step 6, solve for P ^ from the matrix Rlccati 

PA + A P - P BR l B J P +0=0 
l l-i 1-111 ii 

Step 8: Feedback matrix 

(1) Obtain the feedback matrix F^ = R l B J P i 

(ii) Compute F = F 

(iii) Update F = F J _ 1 + F^ 

Step 9: Weighting matrix 
(1) Compute 0, = 

(ii) Update 0, = Oj.j + Q y 


(14) 


algebraic equation, 
(14) 


Step 10: If the required number of eigenvalues are not shifted, then change j 
and go to step 2. 

In the present work, a combination of the inverse square method and modal 
control method is adapted in arriving at the required weighting matrix for 
state deviations. 
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V. RESULTS 


The nominal trajectory corresponds to the fuel -optimal condition of 
orbital transfer with plane change [7], At a particular point of time, the set 
of nominal values used is 

altitude, ti = 44724.24 m 
velocity, V = 9278.73 m/sec 
flight path angle, y = -1.092 deg 
latitude, <t> = 0. 1954 deg 
heading angle, 0 = 9.424 deg 
lift coefficient, C = 0.3231 
bank angle, <r = 75.28 deg 

With this set of nominal values, the linearized model is obtained and used for 
LQ regulator. For a typical set of perturbations, the solutions are obtained 
and presented in Figs. 2 and 3. Figs. 2(a) through 2(e) show the state 
perturbations, while Figs. 3(a) and 3(b) present perturbed controls. The 
guidance scheme is tested at different points on the nominal trajectory and the 
is found to be good. 

VI. CONCLUDING REMARKS 

A neighboring optimal guidance scheme based on linear quadratic regulator 
-has been designed for controlling an aeroasslsted orbital transfer vehicle 
performing a plane change. The down range angle, instead of time, has been 
used as an independent variable. The problem has been formulated as a linear 
quadratic regulator with perturbed states consisting of altitude, velocity, 
flight path angle, latitude, and heading angle, and perturbed controls 
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consisting of lift coefficient, and bank angle. The weighting matrices in the 
performance Index have been chosen using a combination of heuristic approach 
and optimal modal control method. The results have been presented for 
fuel-optimal condition of aeroasslsted orbital transfer. 
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Fig. 2(c) History of fligth path angl 
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Fig. 2(e) Histo 



Fig. 3(a) History of lift coefficient 
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Fig. 3(b) Histo 



